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ABSTRACT 

Funding for the fcraa^j ^ and aaintenance of 23 
research laboratories and centers has, : i the past, coae froa the 
OSOE, adainistered by one of its units Legislation is currently 
pending before Congress that would create a National Institute of 
iiducation and transfer soae of the responsibilities, including that 
of funding vork in the laboratories and centers, froa the OSOE to 
NIE A new institutional support policy has been devised which 
selects and systeaatically arranges eiisting coaponents, aany of 
which have eaerged oYer tiae since the first institutions were 
founded. The objective is to develop decision acdels, assessaent 
criteria and aethods, and aonitoring procedures that are appropriate 
to prograa objectives and policies and to the institution •a achieved 
aaturity. (Author/VR) 
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rtbniary 8, 1972 
flYC 

« 

MMIACmUT rOLICY rOA lKSTlTUnc:i\L SUPPORT 

AMD ASsrssrncT 

IKTPn AUCTION 

Iho United StflCcft orfic« of Education (USOE), through th« Dlviiilon 
of Hoiicarch and DcvclofHM'nt Rciourccs (DRDR) as of this vritlng 

•tipporr*: ?) intt itutions. These fncludc: 

I 

• 11 regional educational laboratorias ; 

• 10 univarsity-bastd KLD ccnttrs; 

• Ihr National Program on Early Childhood Education; and 

• The ICatloral Center for Higher Education Manageocnl Systeos 
at UICHE. 

. In t) e trief seveti-yaar oeriod that has encocRpasscd the life ipan'* 
of th^.%e institutions, the USOE has brought sooe of the first 
in.^ti tution^ of thrir kind into existence, nurtured them, ran 
Intrrf trcnco at the Federal level, and helped many of then develop 
strong KLD pra^r/ins with associatec nanagcnent support. In this 
short history, the laboratories and centers can already point to 
Winy significfiat achievcaonts of national importance. Products 
from these institutions have consistently attracted the highest 
ratiugo in evaluation studies such as one recently completed by 

y 

the Educational Testing Service. 

Th ' JJS(yE po lie y tha t ha s governed the support of these R&D 

institutions during their brief seven-year histoiy has largely 
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h%%n 4crlvcd in bits and pieces «• itsuot dtMnded It. Annual 
contracts aro neeotiatad on the baala of luboiitted acopca of vork 
and bud£ct rcquettt. Althouch the recent trend tiaa been to nego- 
tiate the '.nt tirutlonal budget amount on the baala of each of the 
ongoinc projrant, no policy hei been articulated which links the 
funding to the procram. Coe^arisons between institutions and/or 
' progrnnift have been difficult. Recent reorganiaations that brought 
the funding of both laboratories. Jind centers under one adm'nistra«* 
tive unit ouikes the need fora unifora funding p 'Ucy even \nort 
evident • 

Mo explicit support policy statetct^nt has existed that is 
comprehensive and systetratic. Tie previous policy exists prinarily 
in the fopn of guidelines and procedures for the various facets of 
the laboratories and centers. One of the vnfortunatc assumptions 
that guided earlier practices vis that Federal appropriations were, 
by no\7, expected to reach approximately tlVree tinics their present 
$34 nin. ion Icv^.l. This not being the case caused the USOE the 
problem of having to terminate support on sotne institutions in 
order to maintair minimum required support levels in others. 
Since no explicit and generally acceptable policy existed for 
■aking Judgments with regard to terminating less meritorious 
institutions, the USOE staff and their consultants had to handle 
theac decisions on a case^by-casc basis*-vhich it did for 9 
regional labora'toricT and*2 k&b centers.* Fur thermbre , ThTs 
nonpolicy position could not provide a basis for founding new 
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Inttitutlonflndccd It could hardly be expected to ufider tho 
conditions. 

Those 11 teimlnation decisions were difficult ones end not vithout 
criticism, although th^re is en abundance of testltaooy that attests 
to the wisdom of each of tlico, A more serious problem has resulted 
by dcfcult, one that was probably inevit;>le: the previous policy 

has been characterised by einny as one of attrition or, worse, 

f 

destructive conpctition, Tlie survival of the most promising pro* 
grams has required the oidcourse termination of other, less 
promising ones. The resulting attrition has lod. to a lowering 
of morale, decrease in prestige and insecurity ancmg remaining ^ 
Institutions, all of which must oe reversed if the program is to 
be strengthened and the initial irvestr.icnt capitalized upon. 

1hroi;3hou^ their relatively short history, funding for the formation 
and naintcnance of the laboratories and centers has come fron: the 
USOU, administered by one of its units. At the tine of this 
writing, legislatlon^is pending before Congress which would create 
a Rational Institute of Education (NIE) and would transfer scnc of 
the responsibilities, including that of funding work in the labora- 
tories and centers, from the USOE to NIE. It is expected that 
this policy will apply within the framework of either agency so 
that all future references in this paper will be simply to the 
•isency . referring cither to the USOE or the NIE as the funding 
source. ^ 



Th% folloving p«s** dttcrlbe « now Instltutlocul support policy. 
It is new primarily In tht sotcctlon mnd systeMtlcc arrangement 
of existing components many of vhlch have emerged v^ver time since 
Che first institutions were founded* 

OBJECTIVES 

To develop an Instltutlonfl support policy and assoclpted . 
assessment procedures In tlae to support FY '73 funding decisions^ 
vhlch meet the folloving criteria: 

!• provides for the starting of needed new programs to respond 

to current educational problems* 
2. . makes it possible to start and build new institutions when 

such a course of action appears prudent in view of new progren 
re requirements* 

3* allowc a greater degr«^e of control over Federal re^gourcos 
vhile at the sanic time recognizing the autonomy of the R6P 
^nstl tution * 

A* provides programs v;ith target conolction dates from which 
planning for reallocating scarce resources to meet needs of 
Other growing programs can proceed* 
5* provides stability for multi-year blocks of time that 

. I^ecognizes that institutional capabiiity must be built over 
time and does not escalate the level of expectation beyond 
reasonable possibilities of achievement* 



♦ penults and cncoorffgc^t lotiH^rangr pl>innfnjt and rroitrtn 
tuanaficwent which doct not place every program at riik each 
year because of changes In the budget picture or agency 
priorities* 

. accepts the rink inherent in research and dcvclopraent* 

6« provides a period of supervised gro^l'^h for new Instltutlms 
during vhlch tine they develop the focus that vlll guide 
their future PfJ) endeavors* 

7* .delineates a mechanism whereby the institution can broaden 
its base of sunport by soliciting funds fvoo other Federal 

r 

and non«*Fcderal sources. 

» 

8« provides better balance in the R&D effort in: 
. najor educational problvn areas . 

. the several fur.cttonal areas , i.e., research, development, 

field testing, and ir.plcmcntation. 
. representation of major geographic areas . 
9. is compattblo uith the nlr.nned funding; policies of the NIK in 
anticipation of a possible shift of responslbilltiea regarding 
the laboratories and centers from the USOE to the NIE. 

In summary, the objective is to develop decision models, assessment 
criteria and metliods, and monitoring procedures which are appro- 
priate to program objectives and policies and to the institution's 



achieved maturity; to.:avoid any pretense that the institutions 
arc administered from Washington. • 



TMC mtlTUnONAL CONTEXT 

Ihou^ tht n«turt of Ihe 23 institutions v«rios— asptcially anong 
the 5 categories listed in the Introduction— -all can be generally 
characterised as engaging in reseat ch» either basic or R6I>, vhicb 
it adatnistratively organircd into one (or more) prografA(s). In 
fart, the one outstanding characteristic that qualifies an insti- 

1 

tution for leUerLl funding under tuls policy is that it er^sges 

I ' 

in prograisinatic educational research and development. Many other 
Institutions are receiving other Federal support from the USOE 
for educational research projects vho do not so qualify. The pro- 
graanatic approach is designed to bring together a critical mast 
of experts to make a sustained attack on a particular educational 
problem. 

While it is true that specific differences bettv^een programs and 

projects tend to grow fuzzy, there are some general concepts that 

do distinguish them. In the JouriKil of Research and Developr.ent 

Kducfttlon John Hemphill distinguishes progrnr.s and projects in 

that the fomcr is primarily committed to the '^attainment of 

objectives'* while the latter to the ''execution of a set of 

II 

planned activities." Of programs he says, "the outcomes. .. .are 
of first importance." "If one strategy .or approach proves 
Ineffective, then it must be abandoned and replaced with another 

he States, "Provided that the projects are of high quality and 
arc faithfully and efficiently carrl^ed to conclusion, a project 



can be said to havt been ^11 mMna^o^ rc(«rdlc»t of Itf outcooo*'' 



Itord Miion descrlbot tho differences in en "uncertainty principle 

2/ 

of research and development*" He areuos: 

Uencarch and Development cannot be planned with certainty. 
It follows that if time and budget are fixed, the outcome 
cannot be assured and there can be only limited account- 
ability for it. The corollary is that if the objectives 
are fixed, i.e., there is accounlobiliry for the 
achievement of objectives, then time and budget must be 
allowed to vary in relation to ctncrgent program require- 
ments. Thus, given conmitment to an objective, if inter- 
mediate steps in the process do not turn out as expected 
and it is necessary to go back end start dot.*n a new path, 
administrative arrangenents arc needed for appropriate 
changes in budget and time lines. 



1herefore» the term "program" will be used here to designate an 
institutional strategy and aasociated activities for accocnpUsSing 
• certain set of educational objectives « whether the objectives 
arc designed to correct some educational deficiency or to validate 
mny aspects of a theoretical base. 



"rrogram" can include basic or applied research, developraent, 
field testing and dissmination. It is typically, though not 
meccssarily, multi-year^in duration, i^or the purposes of this 
paper a program will be assumed to be a collection of several 
components, each of which may resemble projects with milestone 
points at which interim ouccocnes or evidences of progress can be 
observed and assessed, and which have definite completion dates, 
feach program will be described by a comprehensive program plan. 
■Unnrfceiay may "thererore use the program plan (or plans) as a 
basic unit for the allocation of its institutional funds. 



- • - 

Another ditiinction that wist be Mde it bctvttn cote support and 

fio^ram support . Core tuppcrt it a tent that hat bceii used in tuiny 

different contextt. It it used in thit paper to dotignate fundi'ig 

vbicb it tpecifically earearked for itanancriaK technical and 

pertonnrl t^rvicct apart from the context of any prograa* In 

general 9 core tupport vill refer to the cott of operating the 

Iv'ttitution irretpective of the work that^t being done. Program 

support^ on the other hand, vilT refer to the cott of delivering 

oo the ttated object ivet. According to thit utagc, an inttitution 

recti vet tupport on one bat it 01; the other but not both. The tame 

cott ftctort are repretcnted in both core and program support. 

the difference is in the method uited to conttnict tbe bu f ^.ct . Of 

courte, the latter prcsupposet that the institutio nat foreulated 

itt work around pro^^rams which are sufficiently clear to foroi a 

batit for budgeting, Thit tupport policy vill ute core tupport 

at a basis for furdlnr. ncv institutions and profirarr support as a 

basis for fundtnct rnturc onc^ . The maturity model will be 

discussed in a later section. 
• 

A final clarification is in what is meant by moral conraitment . 
Since there are legal problems in coenitting Federal funds to 
Milti-year programs* a moral comiitnent is used as a self*imposed 
obligation by the Federal Government to provide continued annual 
funding to the agreed upon programs vithin the limits of the 
e w g r e wfe yeai't a[ypiupi laitOU. ffli Igfet^g y^irTll'^ntihue Fo^furid " 
the' program to %ihich It hat coonitted ittelf throughout the 
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;tPaiplQtioii of the progr^ji as presented in the plan subject to the 
•vttllabllity of ^^nds and the satisfactory execution of the program 

IV. THE INOilTUTIONAL MATURITY MODEL 
• 

FrogravMttc research demands a level of maturity In management 
that one cannot expect to find except among experienced instltu- 
tiuns. One cannot expect to begin doing programnatic rescsrch 
from A standing start— there is much more to it than simply com- 
posing a program plan. Programnstic research Is usually a team 
mffort. often involving sophisticated technical and professional 
Mpport. Such things as site location, staffing, staff training, 
alteration and equipping of facilities all precede the ability to 
do progrAiucatlc research. The staff must have a '"critical mass" 
of experts viUlng and able to converge their interest on a 
•peciflc problem or class of problems. Such teams arc established 
through \/orking on conmon problems as a part of an institution 
over a period of titcc. Prior to the establishment of the current 
educational laboratories and centers beginning In 1965, there were 
few Institutions who were ^alificd to carry on progrftrttiatic 
research and development in education. 

Even though several educational R&D organizations do exist that 
have demonstrated their competence to carry on progrAtnmatlc 
research, more are needed. Only a few educational problems arc 

mow lieing sysKiUCieaily JiLackml smHexlrMng-R&D-^iM^tutions ^ 

ere not equipped for many additional problem areas. Nor la it 
meceasnrily appropriate for all new problcm-^olvlns efforts to 
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be undertaken -by established RM) institutipns. There Is obviously 
much to be gained by a fresh team taking a new ap^jroach to new 
problems* It seems grossly uneconomical to some that one institu- 
tion should be phased out follov;ed by the establishinent of a new 
one. While the j.ustif icatiou for this practice is not presented 
here in adequate detail, it is often not only practical but 
desirable, IJhen an in<:i:i rnf-i^pn's competence ceases to be relevant 
to current needs or it has in other ways ceased to be a viable l(&D 
institution, it may be easier and less expensive to replace it 
than to rejuvenate it, The'proposed policy x^ill accordingly make 
a deliberate attempt to facilitate the founding of new institutions. 

. i 

It is* assumed that a new institution should not be expected to 
manage its research efforts programmatically from its inception. 
Therefore, a sequence of core support leading into prof>rgm support 
forms the basis of the maturity model. 

« 

The Federal Government will, at appropriate times 'jhen important 
education problems ar^sc, stimulate the submission of Institutional 
Planning Grant proposals , relatively short documents submitted by 
Individuals or consortia who wish to propose the establishment of 
a new educational R£cD institution. The proposals will lead to the 
award of a Planning Grant , 

With the award of the planning grant, the potential institution 
enters the preins t i lu t i onal phase , a negotiated period of three 
to six months duration. Guidelines will be available from the 
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agency for the proposal, though no rigid formatting requirements ... 

♦ 

will be imposed, The proposals will be evaluated by an outside 
group of revievers and their recoirwiicndations, together vith those 
of the agency staff, will be subndtited to the agency's director 
for final selection. 

The purpose of the Institutional Planning Grant will be to enable 
the preparation ot r c^rqtrriVr'^T^/e proposal for the establishment 
of the institution. More than one Institutional Planning Grant, 
may be awarded v;ith the intention of rejecting all but one proposal. 
The award of an Institutional Planning Grant does not assure the 
grantee that the proposal he develops for the new institution will 
be funded. 

■ I 

The tine sequenced activities shown in Figure 1 illustrate the 
various stages of the maturity model, from the Institutional 
Planning Grant to the mature. Phase III institution. 



Figure 1 

Stages of Institutional Growth in the Maturity Model 
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I 

fH% institution la said to ^Snature" as it s^^du^tcs from one cell 

to tho ncxtp moving from left to right on the chsrt. Associated 

vith each of the f nir points of advancement is a review decision 

that Siust be r.'^de by an assessment team. The assessment proce* 

dures are described in brief later on in this document and in 
« 

detail in an associated document. 

i • ^ 

Each of the four rcvlcv dccirlons moy r<»sult in the loss of funding 

I ' 

from the agency. If the funding is terminated as a result of a 
negative review, the institution may not be reinstated except as 
a new institution. 

I 

Having successfully completed the maturity process, the institution ^ 
becomes eligible for a policy of reduced agency supervision and 
reviev;, and for increased independence in the invcsttaent of Federal 
funds • 

A new institution is recognised following a positive review at 
step two, and then the Institution enters a three-phase ^'matura- 
tlon** process. Thes^ three phases and the characteristics of the 
funding process arc described as follows: 

Phase I: Developtnent of a Prog^ram Plan 
The agency will provide core support for: 
. Development of program plans 

, Jlnsiy.tinjonaJ_ fuj>c^on^ their development. 
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Iht proposals for « nev Institution will given a thorough 
ravlcvt both vitUin and outside the agency, Agaln^ the final 
selection vil! be made from recommendations submitted to the agency 
director, The award is in the form of a one-year contract, ncgo- 
tiatcd from the scope of work outlined in the proposal. The scope 

i 

of work vill delineate the steps which must be taken to organize 

] • ' ✓ 

the institution (e.g. » to incorporate, select a board, establish 

J ' • ■ 

an affiliation with the sponsoring agency, seek faculty appoint* 
aicnts, etc,). Secondly, the scope of work will guide the ncv 
Institution in defining its mission and developing a comprehensive 
program plan according to the guidelines furnished by the agency. 
Imp etncntation of the; new plan will occur during Phase I as time 
and funds permit. Finally^ the scope of work will also permit 
alto selection, staffing, etc. 

No more than one renewal contract will be issued for Phase I, 
providing a maxirRum total funding ; of tvo years . Funding vill be 
of a core support type, negotiated annually from the scope of 
work statement, ^ ^. 

Graduation to Phase II will be contingent on the completion of 
at least one program plan that has been judged by an outside 
review panel to merit further support* Criteria for the support 
of the program plan will be the same as those for mature, Phase III 
Tn stltutions, Jlo i^rvrr annr^mueiiL piOfccaures will make certa in 
allowances for the newness of the institution and the experience 
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that is to be gained In the next phase. Termination of support 
after the tvo-year Phase I period will result from failure to 
come up with an acceptable plan* 

Phase II; Mnnagcmenr of R&D According to Program Plan 
The agency will provide core support for: 
• Program plan refinement efforts 

« 

« Core institutional functions 

« Specific substantive program activities 

* * 
binding in this phase will be also based on core support and an 

annual contract that is negotiated from the scope of work to be 
performed. The agency will vork closely vith the new institution 
during this phase to help bring past institutional R&D experience • 
to bear on its needs and assure that management capabilities are 
developed that will permit it to progress to Phase III. There 
will be four main objectives during this period. First , staffing 
will be completed so that the management of the new program will 
not be hampered by inadequate staff. Second , the R&D program as 
outlined in the program plan will be brought into full operation. 
The success in ability to manage R&D efforts as outlined in the 
plan will largely determine whether the Institution will ultimately 
survive ani graduate into Phase III. Third , the program plan will 
,be refined so that it is more operational in light of the expe* 
rlrrt^^ ^ ■ )^.] ^, „i ^m. i ■ 7-. ^^^Vf-ff^f^.fq^^^ detail to 

the requirements imposed on program plans as specified for Phase I^ 



institutions. Fourth s the business office of he institution 
vill shift its budget lines so that all expenses are related to 
program objectivesp 

Except in rare cases, Phase II vill last no more than two > ars* 
A thorough assessment vill be conducted at the conclusion of the 
tvo-year period, Ihe assessment vill have three parts: 1) a 
. » review of the relevance of current efforts to the institutional 
mission, 2) a review of institutional management and accounting 
capabilities, and 3) a rcviev/ of program plans. Guidelines and 
review criteria vill be available from the Federal agency. The 
program plan review will be conducted in the same way as for a 
new program plan submitted by a mature. Phase III institution, 
* Termination vill result from inability of the Institution to 
adequately manage its R&D program plan. 

Phase III; Mature Institutions Independently Dovelooing and 
InplcTnentlng Program Plans 

/ 

Uie agency will provide program support for: 

• Program plan budgets^ 

• Capital facilities development 

• Independent research 

• Fee structure 

Oki graduation into Phase III, the institution becomes much more 
Independent from the agency and^ is then regarded a sl^. Important 
educational R&D resource whose work contributes significantly to 
national needs. 
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Vhen additional capital facilities development money becomes available, 
tprants vlll be limited to institutions which are in the Phase III 
c;atesory« ' 

!I!he agency's commitment in this phase is to ihe entire period of 
research and development activity as described in the approved 

^program plan* Though such multi-year commitments can only be moral 
ones, the institution is assured that the question is no longer 
vhetVer to fund the program but how. Surveillance of the progress 
vill largely be the responsibility of the institution and the 
Tevie\7ers that it designates. The Federal agency vill participate 
Init only in a minor role and as required to protect its capital 
investments. Only v;hen there is cause to suspect that the progra»A 

*i8 in need of outside intervention vill the agency again take the 
initiative for. assessment. This could occur if the program is 
knovn to be in trouble, if the management of the institution has . 
suddenly changed, or if it becomes obvious that productivity could 
be greatly increase! by expanding the program plans. 

Fhase III has no definite time period associated with it. The 
level and duration oi: Federal support is directly related to the 
iMiimber« size and duration of the programs to vhich commitments have 
been made* 

•To naintain Phase III status, the institution must maintain its 

• ^ 

reputation for doing quality educational R&D vork. This vill be 
reinforced for the agency at the conclusion of each program, vhen 



the outcome assessment Is done« (Outcome assessment vlll be 
discussed In the next section along with the other types of 
assessment for mature, Riase III institutions*) 

Not all agencysupportcd Institutions will have gone through the 
siaturation model (Phases I, II and III) presented here nor is 

i 

there a logical reason why all should. Some vill have gained 
prerequisite experience through other funding sources and may 
be ready to ep^ly fwr'?hu.wu*.7^> status immediately. To do so they 
must go through the same assessment procedures as though they ijere 
Just concluding Phase II, institutions vill not be allowed to 
regress voluntarily to an earlier phase--the core support will only 
be available to new institutions (Phase I and Phase II) or when it 
is in the best interest of the Federal Government to rehabilitate 
a needed instituclon. 

The agency will be organized in such a way to facilitate the operation 

of this support policy: monitoring, negotiating contracts and 

A / 

managing reviews as necessary. 

Except as noted above (fore support will not be available to mature 
institutions*-th3 funding will be budgeted to ongoing, approved 
programs. Institutional overhead, fringe benefit packages and 
other indirect costs will be* prorated across the programs, 

TWo additional line items will appear only in the budgets of the 
-ma ture,* -phase- 1 H -institutions^: "otfe' f or* independent r^searcIT anH 
the other a management fee. 
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Independent Research 

Hie purpose of the Independent research money is to s«jpport» on 
a cost-rcltnLursable basis, those programmatic research activities 
that may be only marginally related to the main budgeted program- 
matic effort. It might be used by the institution to start new 
initiatives in related areas by conducting feasibility studies, 
needs assessments, etc.; it might be used to supplement another 



programmatic thrust to enlarge the yield of that effort; or It 

'•* * • 

oight be needed for maintenance of activities related to outcomes 
of previous prograncnatic commitments. 

The activities to be supported by the independent research 
portion of the budget must be consistent vith the mission of the 
institution (i.e,, the objectives that guide the institution in 
the selection of their endeavors), labile It is not necessary that 
it be spent for the program in whose budget it appears, independent 
research money V7lll be spent on ac* i ities which complement that 
program inasrmjch as both will relate to a common institutional 
mission. 

Tlie independent research money will not be used 1) to build a 
reserve fund, 2) to engage in activities designed to reorient the 
Institutional capabilities in ways not intended by the sponsoring 
agency, 3) for the purchase of laboratory equipment and other 



capital assets (vlthout_£r lor .agency -approval)^, ^or 4) for costs that 
are not otherwise normally reimbursable. 
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Essentially, the added advantage intended for the independent 
research portion of the budget is the freedom to support the 
needs of a variety of activities vlthln the Institution in order 
to permit a degree of flexibility and local initiative necessary 
to maintaining a high quality institution. It is not intended to' 
be a means of acquiring capital or building a reserve. • 

The independent research costs arc not expected to exceed B7. of 

direct program costs. 

* 

Management Fee 

The ]|>urposc of the management fee is to enable the accumulation ^ 
of a reserve to provide operational stability during temporary 
fluctuations in contract support and vhile contracts are being 
renewed, to enable the payment of necessary and reasonable business 
expenses not covered under the direct and indirect provisions of 
the contract and to enable participation in endeavors that require 
limited operating capital such as Federal cost-sharing activities. 
The fc.e, as determin/»d by negotiation, will belong to the con- 
tractor subject to appropriate disclosure of use. It will be made 
In the form of a grant to the contractor at the beginning of the 
contract period. 

The management fee is to be based on the needs of the contractor and 
Includes limited amounts to cover thctc necessary and prudent costs 
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Fees can properly be used for such things as: 
« temporary payment of operating costs during periods between 
contrac'L^. 

• recruitment and relocation costs for high caliber talent. 

• cotmnunlty and charitable obligations, 

« building program capabilities vhicK are^elevant to the work 

being contracted, ' . 

« modest and reasonable business entertainment expenses, 

• Interest on loans, ' • 

• reasonably incurred penalties and fines, 

, to build a limited reserve fund to be used for operational 
Stability. 

1 ■ . ■ 

, legal fees, . * . 

: / 

It will be improper to use fees for such things as: 
, accumulation of a large reserve working capital, 
, the purchase of buildings, property or other large capital 
assets, 

, Incentives that will accrue to the benefit of individual 

employees to the exclusion of others, 
, any extravangance in travel or entertainment expenditures. 
, endt^avors which are intended to enhance! the capability of 
the Institution in an area that bears no relationship to the 
eOffCFiTci: or the desires of the funding agency. 
, endeavors intended to reorient the motives of the Institution * 
to place thorn in competition vith private business. 
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• support of an Independent research program (covered elsewhere 
on a cost-rclmbursable basis)* 

Once the ^^es h<;vc been determined, they belong to chc contractor 
to be administered from the office of the director. However, to 
ensure that appropriate use is made of the fee, each year a dis- 
closure of the uses made of the fees -will be required and used as 
a factor for consideration of thn amount of fees to be negotiated 
in subsequent years. 

4 

Specific guidelines for the awarding of the fee, to be worked out 
in advance of negotiation vill describe how to justify need« Gen- 
erally, however, the fee normally will not exceed 3Z of direct costs* 

. contributing to a reserve fund that, collectively (including fees 
i . . ^ 

from all sources) should not exceed 3-4 months normal operating . 

expenses for the institution. 

* 

Ihere are two important considerations in the negotiation of fees 
that would appear to warrant an exception to the 3% ceiling: 
' 1) the competitive na^re of the proposed work, and 2) the 
administrative procedures within the institution for handling the 
fee* 

This policy statement has largely assumed that program funding 
commitments are made by the agency on a non-competitive basis. 

Since the laboratories^ and^ ^^"5^^^*^.^^ virtue of t heir non-pro fit 

status and their special relationship to the sponsoring agency, 



art generally considered to bo a valuable and evallable Federal 
resmircey they are often asked to do work on a non-conpetitive 
basis, HowevciT* not all proposed vork will be non*coapetitive« 
Nhen they do enter a competitive proposal as in response to an 
open solicitation by the agency^ the fee negotiation guidelines 
that accompany such awards should be revised upward to a 5% 
eeiling in recognition of the added costs and risks of proposal 
vritingy loss -of the usual non«*coinpetitive benefits (e.g., the 
Program Planning Grant) ^ and to bring them into conformity with 
other bidders. The 5Z ceiling is still veil under the fees 
collected by the private sector in recognition of the special tax^ 
exempt status of the non-profit. Subsequent year continuations 
of that vork should be negotiated according to the lower (3Z) fee 
guidelines since the risk clcneiits will then be substantially 
reduced. 

The second exception is occasioned by the special relationship 
that exists between some of the centers and their parent Institu- 

« 

tion, the university, ^ In some cases the university is providing 
8ome cost-sharing with the funding agency and in all such cases 
there is added complexity concerning the indirect costs. Some 
eosts which the center would normally consider to be indirect 
(e,g«f the director*s salary) are considered by the university 
to be a direct. Therefore there are individual arrangements 
-regarding -thenportiatnjf Chc^rftdltcct costs to be retained bjTThe 
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university for overhead and the portion to be passed m to the 

center for management. It is assumed that the entire fee amount 

be made available to the dlre;tor of the center to be managi 

according to the principles under vhlch the fee Is awarded. If 

administrative procedures do not permit the fee to be passed to 

the center, it should not bo awarded. 

Similarly,^ the Independent vcse:..:h mcncy is to be used vlthln 

i 

the center In the same manner as other direct coated Items, with 
the usual portion to be retained by the parent Institution for 
overhead vhlch Is only, to be taken from the indirect cost pool. 
Where the center Is sharing costs through the resources of the 
university, some tradeoffs should be permitted in the contract 
negotiation in recognition of that fact. However, cost-sharing 
should not be required of one contractor unless it is required 
of all. This is Important to the implcr.entation of a uniform 
policy. 

A further discussion of these exceptional Issues regarding the 
fee is attached (Attachment C). 

As a general guideline, fee money should not be used for the 
purchase of pieces of equipment where the institutional invest* 
sent in the total configuration into which that piece fits 
exceeds $10,000. This includes such items as computer systems, 
printing apparatus, etc. The lntcnt^ls*that"T??SWi"*approval— la 
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given for purchase of such major Items, it will bo financed by 
tho basic contract, 

Peea should not normally be used to forward finance the costs of 
operating the institution. Such finan ing will normally be pro* 
vided through advance payments or letter*of-credit arrangcmentSt 

Iho expenditure of fees without disclosure will Jeopardise future 
fee £.vaTds regardless of the reserve level. Income derived from 
the investment of fee reserves will be taken into account in future 
awards^ Any fee reserves derived directly or indirectly from 
awards made by the funding agency may be reclaimed by the Federal 
Government at the time of the dissolution of the non-profit 
. corporation or if the misrslon of said corporation changes to such 
an extent that it is no longer conducting educational research and 
development work. 

SUPPORT OF PKOGRAIJS WIlHIN MAIVRE IKSTITUTIONS 

Ihia section describes in greater detail the monitoring and review 
sequence for agency -sii^por ted programs in mature (Ph^se III R6J)) 
institutions. The diagram in Figure 2 portrays the sequencing of 
a typical program* It illustrates three stages » six types of 
review^ and two areas of agency responsibility. 



Program 5;ta;t<^s 



faflgrjin Plant will ^ge <i eg ally be WLiLLtri vitn the aid of a Program 



Planning Grant . A Program Planning Grant may be awarded to a 
r^.^turc, riiaso III inrtltutloa for the purpose of devclcpinp plans 



FIGURE 2 



EVCKTS IN AN AGENCY- SUPPORTED R&D PROGRAM FOR PHASE III INSTITUTION'S 
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A Program Planning Grant will be awarded to an institution, on the basis of the Propose 
Review (3) in order to develop a basic plan for a needed educational R&D program* An 
extensive Initial Review (6) will determine whether the agency will make a moral commii 
eent to support the program through to its completion* If the program Is selected by 
thn afion g v i th a n i i i inr . «€>n<i Rovipun (7) . will bo cott^c ted- a t -the -coiftp te t4on- of— &-i^nirf 



components of the program. An Outcome Review (8) at the end of the program will obtaii 
accountability data and will be the basis for Implementation decisions . By exception, 
Mjor Intervention Review (9) will be conducted when important changes m support or 

Irection of the propram is indicated. Annual budget adjustments (10) will -be made 
MCCordin^ to available funds and program needs. Tlicsa six revicv^t together vith the 

l|g[^(^Eour (in figure 1) make up the 10-step assessment system. 
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for needed agency programs* The Institution will submit a brief 
proposal vhich outlines the intentions of the institution. Awards 
generally covering a period of about three months, vill be con* 
tingent on current national needs. Federal priorities, and the 
availability of funds* The award of the grant does not imply 
agency commitment to the proposed program*- -that determination is 
made later* 

«• • 

The Program Plan will describe a comprehensive, multi-year R&D- 
effort, including major components, expected products, delivery 
schedules, projected funding requirements, management plans, 
assessment plans, reporting plans, and implementation strategy* 
Major milestones will be delineated in such a way that milestone 
outcomes can be reviewed readily* Complete instructions for the 
content of the program plan is available in a separate document 
(see Attachment A)* As noted in that document, long-range plans, 
may have to be broken into discrete segments of three to five 
years each in order that reasonable projections can be made by the 
institution and thereby a reasonable commitment can be made by the 
agency* Where such phasing of a long-* range plan does occur, agency 
commitment covers only the current segment* 

It is sometimes necessary to make substantial modifications to an 
ongoing program plan because of unforeseen events that have taken 
place* When this occurs ,_thejmod i f.i_cd p^laxi .will be submit ted to__ . 
the agency to confirm continued commitment-*- such commitment should 
not be assum<?d. In general, the n r.encv will continue to fund a 
program to which it has Riven moral commitment throughout: the 
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completion of the program, subject to the availability of funds and 
the satisfactory execution of the program ^ 

While the program plan will include a discussion of implementation 
plans, the latter (if they are extensive) will often have to be 

vrlttqn up as a se*pardte plan since other sources of agency support 

/ I - 

'might reasonably be expected. 

Program plans which have been developed under a Program Planning ^ 
Grant may be submitted to other agencies for possible funding* 
HoweveiTi the institution must*use discretion to avoid possible 
charges of having unfair advantage over competitors in that Federal 
money would be used in the planning effort. 

Budgetary Provisions 

Ti70 different kinds of budget submissions will be required: . the 
projected, multl*year budget for the entire program, and the more, 
detailed annual budget submission for the coming year's vork« The 
first is a part of the Basic Program Plan submission, the latter 
will appear in the Annual Budget Justification, 

The Basic Program Plan budget will contain macro cost figures by 
year and major components for the projected commitment period. 
These cost estimates will include all direct and indirect costs. 
Independent research and fee estimates will be projected on the 



basis o i iind 2% uf diro 6 t ^ c o&J:&^x^&pectlvcly, A sample 



budget table shown in figure 3 gives sqbtotals by major activity 



) and by year. Additional tables might be used to show such things 
as manpower projections, overhead expenses » etc* 



FIGURE 3 



SAMPLE BUDGET FOR A BASIC PROGRAM PLAN 
(Thousands of Dollars) 



t 

Components 


1973 




1975 


1976 


Component 
Subtotals 


"A" • 


135 


170 


65 




• ' 370 


"B" 




. 210 


200 


200 


620 






95 


i 315 


AOO 


810 


i 


120 


120 


125 


. UO 


505 


Annual 
Subtoiials 


265 


595 


705 


740 





Grand Total . 2305 

A much more detailed budget will be submitted in the Annual Budget 
Justification, This will present a costing of the operating expenses 
q for the coming year's R&D activity. An example of such a budget is 
included here (figure 4). It is understood, however, that the**^ 
independent research and management fee line items would appear in 
the budgets only for mature, Phase III institutions*<^institutions 
located at earlier stages in the maturity model would not be 
eligible for these funds. . - 



FIGURE 4 

SAMPLE BUDGET TABLE FOR THE ANNUAL BUDGET JUSTIFICATION 



SOMEWHERE REGIONAL UBORATORY 
FY 1973 BUDGET FOR PROGRAM "A" 

1. PERSONNEL COMPENSATION * TOTAL $_ 

a. Salaries and Wages $ 

b. Consultants 

c. Other • 



6» PRINTING & REPRODUCTION 
a. Printing 
' b. Duplication 



2. PERSONNEL BENEFITS • ^ TOTAL $ 

3. TRAX'EL AND TPw\NSPORTATI ON OF PERSONS TOTAL $. 

a. Staff $~" . 

b. Consultants 

c. Other 

4. TRANSPORTATION OF THINGS . 

5. RENT. CO>MUNICATIONS & UTILITIES 

a. Facility Rental $ 

b. Equipment Rental 

c. Telephone & Telegraph _____ 

d. Utilities 



TOTAL $_ 
TOTAL $ 



TOTAL $ 



10. IKDSPECTENT RESEARCH 

a. Activity -jl r 

b. Activity #2 
Etc. 

SUBTOTAL DIRECT COSTS 

11. INDIRECT 

12. IIANAGEMENT FEE 

TOTAL DIRECT, INDIRECT & FEE 



TOTAL $ 



TOTAL $ 



TOTAL $ 



Note: Independent Research and Fee lines appear only in the budgets frora 
Phase in (mature) institutions. 
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The sample budget illustrated in figure 4 would be supplemented 
in the Annual Budget Justification by other tabular Information 
auch as that which shows crosswalks by major activities as well 
as by other categories. The FY 1972 guidelines for the Annual 
Budget Justification are attached (Attachment B)« 

Implementation 

Implementation is meant to include all of those activities that 
are required to get an R&D outcome into its intended use* This 
can include such activities as field testing, market surveys, 
dissemination of information, negotiation with publishers, on-site 
demonstrations, and a myriad of others. At issue here is the 
question of what part of the implementation strategy belongs to 
the R&D process, and hence should be included for funding in the 
research and development stages of the effort. If the sources of 
funding are common for both the developmental and implementation 
portions, the question is academic; one plan would suffice for 
^ the entire effort. However, there is some likelihood that 

•responsibility for the^two kinds of activity will be partially 
If not completely divided among different Federal agencies and/or 
legislative authorities. If so, where does the responsibility of 
one leave off and that of the other ensue? 

Ihe answer given here is a natter of principle rather than a set 
of guidelines. The notion that all implementation costs should be 



ERIC 



kopt separate 'from all R&D costs, and funded separately, is rejected 
on several grounds: 

1. Llmit^'l implementation activity should normally begin at the 
very outset of the program (e,g«, needs assessment, market 
survey, contact with publishers, etc.). This is usually too 
early in the process for those whose primary interest is in 
Implementation to begin funding that activity, 

2# There is clearly an R£J) component to implementation, including 
the validation of the outcome through field tests and demon- 
strations, building an implementation strategy, etc« 

3, Many activities cannot be neatly categorized into R&D or 
implementation (e.g., needs assessment, joint efforts with 
publishers, etc.). 

k. It is rare to find a point of time in a program V7here R&D stops 
and implementation begins-^-one can, at best, find a difference 
In the weighting of emphasis. 

Therefore the principle is to choose an arbitrary point, based on 
projected delivery schedules, where the emphasis will clearly shift. 

Figure 5 graphically illustrates the above principle. While it is 
not proposed that the pictured relationships are valid for all 
programs, or any one in particular, there is an acknowledged pro- 
gression. Developmental costs typically exceed research costs 
by an order of magnitude ana impT^merttirtrlotr cos ts ' a re -of tcn--anothjer_. 
order or two higher. The graph also shows a great deal of ovcj-lap 
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between activities « Ihe axes are not calibrated since these are 
highly subject to individual differences, Ihe twofoldJprinciple 
ia Illustrated by the broken lines, namely: 1) that there exists 
a practical ceiling above vhich R&D money should not be used to 
support implementation costs, i^e,, the horizontal broken line, 
and 2) that there also exists some "bail*out" point beyond which 
the program should no longer be considered an RSeD effort, i,e«, 
the vertical broken line# The residual R&D effort that continues 
into the Implementation period can be continued through the use 
of independent research money from other funded activities. 

• • I 

Ihe effect of this twofold principle is to recognize that R&D 
resources cannot and should not have to bear the high implementa* 
tion costs; it provides a rationale for a gradual phase-in of 
implementation funding to start near the end of the main develop*, 
nent effort .as veil as the shift of primary funding to non-R&D 
sources. There is clear recognition that these ^'target end dates** 



/ for the R5J> vork must be set quite arbltrarly but with adequate 

reasoning. It also avoids the problem of the classification of 
activities (usually artificial at best) into categories of R&D 
versus implementation. 

The Institutional Role 
' Khlle the policies vhich have been discussed in this paper thus 



xar nave strcssedn:7tc funding of'prbgrams vithl.; institutions, 
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little has been said about the role of the Institution Itself « 
This polity does not subscribe to the notion that the institution 
Is nothing more than a collection of its various activities — as the 
program funding might seem to imply* On the other hand» this vlll 
not be an attempt to define vhat constitutes an institution. 
Rather^ certain Institutional features are highlighted to set apart 

# 

the intent of this policy ftom the funding of scattered R&D proposals « 

First s to qualify for program fynds under this policy^ the 
institution must be approved in the sense that it has been placed, 
by formal review, into one of the categories of the maturity model, 

i«e«. Phase I, II, or III. This could be a nev; institution. Just 

/ 

starting the sequence, or an existing one that is looking for an * 
approved status*. 

Second, the institution will possess a valuable expertise, 
developed from the mission vhich brought that particular cluster 
of talent together into a corporate body« Institutions assigned 
to Fhas*e I or Phase It vlll be assessed partially on their ability 
to develop such a mission and to focus their activity in relation 
to it. Phase III institutions will be expected to discipline 
themselves regarding choices of activities vhich are consistent 
vlth their mission. Ihey will not be prevented from modifying 

ml ti^«^^/)ir^ fci^ t ^hcy ccrtalnly ou^ht not to abando n it. InstI* 
tutional mission will be an important consideration in reviewing 



a new Basic Program Plan as an indicator of appropriateness for 
that institution to do the work* 

Third , the institution vlll have a management team that directs 
the ongoing activity and a sponsor to vhich it is accountable. 

This will often be the director, his deputies and the board of 

» » 

trustees, or the parent institution in the case of university-based 
centers. All requests for funding must be transmitted through the 
management with the backing of the institution, and all awards must 
be negotiated vith the director (or those whom he delegates). This 
policy* specifically disclaims the use of communication channels 
between the agency and the institution for matters of business 
(e.g., proposing, funding, performance standards, etc.) other than 
those approved by the institution. Sub-units may not submit 
proposals without institutional appro\'al. 

Finally , although the agency will be reviewing management practices 
of an institution only during its first fev? years of operation 
(Phases I and Ily, that should not be interpreted as a lack of 
Interest in the management of Phase III institutions. Rather, it 
Is assumed that the management sophistication of these institutions 
will have outgrov/n the assistance that the agency has to offer. 
But, in any case, inferior management in these institutions will 
eventually become evident in poor plans and performance which would 

beT.'ilccly''tr<F re^lt^ til intervention reviews -and/ot^unsucccssfal 

proposals. 

i 



Areas of Aftencv Participation • * ' 

There arc two major areas of responsibility for the Federal funding 

5/ 

agency in the support of R&D programs. First, there is the kind 
of evaluative role that leads to funding decisions, or the quality 
assessment role. Those responsible for quality assessment must 
organize and manage the various reviews that have been discussed 
(with the exception of the milestone review). They must translate 
these reviews into recommendations for use in making the funding 
decision, and be able to back up the decision with facts once it 
has been made. Their contact with a partitjlar institution will 
not be frequent but will have major importance with regard to 

funding. They will be answering the question, whether, . i.e. , 

' i • • . 

vhetlier to fund, whether to graduate the Institution, whether to 

make the grant, etc. 



Secondly, there is a facilitative and management consultant 
responsibility, or the qttality control role. Those responsible 
for quality control will. be assisting the institutions on a con- 
tinual basis with their current responsibilities, whether helping 
to strengthen the management of the institution or deciding how 



to apportion a given amount of money among supported programs • 'they 

vlll evaluate the Annual Budget Justification in relation to the 

Basic Program Plan to assure that the R&D effort is still on track. 

1!hey vill negotiate the annual contract, not deciding vhether, but 

hew and yhen . Together with the institutions they vill make the 

nanagement decisions that vill provide the best stretch for the 

available dollars and maintain the integrity of the ongoing pro- 

grams. Their role is described by the adjectives, nurturant, 

facilitative, advocacy, consulting, etc. 

* 

THE ASSESSMENT SYSTEM 

The assessment system for the institutional maturity model and 
funding-by-program policy is structured around a 10-step review 
* process. The assessment to be performed in each of the 10 reviews 
anist provide a definitive answer to one key question in each case.. 
Each type of review is keyed to a particular critical point in the 
funding process* The consequences of some of the reviews vill be 
more far*reaching than others and, in that sense, might be con- 
sidered more important. This is particularly true with the deci- 
•ion to make the avard for starting a new institution (reviev/ v2) 
and the decision to provide multi-year funding for a newly proposed 
program (Initial review, if 6). 

One of the reviews, the lUlestonc review (^7), is designed to be 
administered entirely by the institution with the Federal Govern- 



The 10 steps of the assessment system are described below. The 
numbering of the reviews corresponds to figure 1 (reviews 1-A) 
•nd figure 2 (reviews 5-10) • Consulting these two figures should 
help to Illustrate the context in which the reviews will occur, 

1, Award of Rrnnts for planning new institutions . An Institutional 
Planning Grant proposal will be solicited from groups and 
' agencies interested in founding new educational institutions* 
The proposal will be reviewed prior to a funding decision. 

The key question to be answered in this review is: Should 
the request for a planning grant for a new institution be 
funded? 

.2, A ward of operational grant for startinr^ new institutions . The 
award of a planning grant will lead to the development of a 
full-scale institutional proposal. The latter will be reviewed 
between three and six months after the termination of the 
plannii.^ period. If accepted, the proposal will provide funds 
Co establish a new institution. 

The key question is: Should a given proposal to start a new 
Institution be funded? 

3, Approval of a new Instilutlon program plan . After a development 
period of one to two years, the new institution will be required 
to submit a report ummarizing its organization and defining its 
crisis s ion. At least one program plan must be developed. • 



llie key question Is: Is the basic prograrn plan of a given 
Institution satisfactory? 

4« Certificating a new institution's management capabilities . 

During this phase the new institution vlll be required to bring 
the program plans into full operation. After approximately tWo 
years a report will be required to determine if the institution 
is mature enough to continue with program support. 

The key question is: Is the institution capable of managing 
its basic program plan? 

5« Award of Grants for plgnnlng hew programs . An institution 
that has successfully completed its maturity review will be 
classed as a "mature institution" and will be eligible to 
apply for one or more planning grants for new programs « 
(Already mature institutions may submit Program Planning Grant* 
proposals without going through decision points 1-4.) The 
proposals for such Program Planning Grants will be reviewed. 

The l^ey question is^ Should a given proposal for a Program 
Planning Grant be funded? 

6. Approval of Basic Program Plans > The award of a new Program 
Planning Grant will result in a planning document that will 
be reviewed. 



The key question is: Should the agency commit itself to support 
the proposed Basic Program Plan to its projected completion 
date?' 

?• Milestone Review > A funded program will have specified 

milestones at which certain phases of the program work must 
be completed. As these milestones are reached, a report will 
be submitted -for Ttvict;. • This assessment, unlike those at 
earlier or later stages, will be made by a review team appointed 
by the institution. The information collected by the team will 
be shared with the agency. 

The key question is: Are significant milestones in the program 
plans being reached, on time, and with satisfactory quality? 

i 

8. Program Outcome Assessment . When a program concludes, its 
final outcome will be reviewed. 

The key question is: Did the program reach its objective? 

9. Modification of Su o nort Conmltnc?nt for llature Institution 
Motivated by Special Circumf.tances . Special circumstances, 
e.g., the departure of key leadership personnel, that appear 
capable of altering the institution's capibility to continue 
its programs, may prompt the agency to investigate (i.e.. 
Intervention review). Alternatively, the management of the 

^ — , instituLion~jnay .clcct--5uch. a .review In order to reuise the . — 

commitment in terms of updated program planning. « 
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Ihe key question is: Do current clrcuTnstanccs of the programs 
or Institution require redirection or changes In agency support? 

10. BudRet and Contract Kevlcv . This revlev differs from the 

previous nine because it occurs annually as a function of con- 
gressional appropriations. Its purpose is to determine whether 
or not adjustments should or must be cV^de in the institution's 

I . . 

funding pattern. 

I 

The key question is: Vlth given funds each year, how should 
any given program be adjusted, stretched, or compressed? 

« Decision points 1 and 5 relate to planning activities; decision 
points 2 and 4 to institutional factors (Initiate, adjust); 
decision points, 3, 6, 7, 8, and 9 to program factors (initiate, 
adjust, terminate); and decision point 10 to annual budgeting 
factors. 

Decisions will be based on recommendations made by review panels 
*inad.e up of expert judges. The judges will be talented professionals 
vho have earned a national reputation in their respective areas of 
expertise. 

The assessment system vill operate within a two-tiered framework 
of review panels, a Master Panel and several Specialist Panels* 

'The Master Panelist s will be drawn from a variety of professional 
areas, will b^ professionals of the highest caliber, whose reputa-* 
tion and experience will lend credibility to their recommendations 



at ell levels of tlie Federal Government* They vill assist the 
agency's director In examining areas of national need, vlll recom* 
mend funding patterns that respond to those needs, and vlll aggre* 
gate specific funding recommendations obtained from the Specialist 
Panels and transmit them to the agency. They vlll, vith the 
approval of the agency's director, manage the major activities of 
the Specialist Panels, defining their areas of concern. In general, 
the Master Panelists vlll not participate, firsthand. In the 
reviews. Instead, the Specialist Panels vill be providing that 
data for them. 

The Specialist Panels vill be composed of peer professional group 
members vho are thoroughly competent In the methodology and tech- 

nology they are asked to review. They will review planning docu- 

■ f 

ments, visit Institutions, and do whatever else. is required to make 
sound judgments. Their recommendations vill be submitted to the 
Master Panel v;ho vill aggregate them and transmit them to the 
agency. 

. An Evaluation Audi tor '^will provide a means for appealing reviev 
outcomes when irregularities are perceived. He vlll be directed 
by the Master Panel in verifying the authenticity of any questionabl 
reviev outcomes. 

Die entire assessment system is described in detail In an attached 
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RELATIONSHIP OF THE PROPOSED POLICY TO NIE PLANNING 

At the time of this writing, NIE legislation is pending before 

Congress, In anticipation of the passage of that legislation, 

the USOE nas esUblished an NIE Planning Unit. In addition, the 

RAND Corporation was consnlssioned to undertake a planning study 

for the proposed NIE, to be carried out under the direction of 

Dr« Roger. Levlen. The report produced by^^.hat study is conunonly 

known as the Levien Report. The' examination of these two sources 

provides the best available evidence of the relationship between 

* 

this policy statement and goals for NIE. 

It is commonly understood that the regional laboratories and R&D 
centers will become a major resource for NIE when the latter 
becomes operational. Under the expectation that this will occur 
relatively -soon, possibly as early 4i8 July 1972, It becomes r 
imperative that whatever changes are made in the method of sup- 
porting R&D in these institutions be compatible with the planning 
for NIE. A short-term change of the magnitude proposed here 

•would not be worthwhile* 

• »• ' ' ■ * 

The proposed policy is completely compatible with the planning for 

i/ 

NIE as Indicated from two primary sources: 1) the Levien Report, 
and 2) the documents which have been produced by the current NIE 
planners. ' .. 



The Levlen Report 

* • • 

Pertaining to the regional laboratories and the R£D centers, the 

Levlen Report states: 

These kinds of Institutions* « .will be essential • 
constituents in the R&D enterprise supported by 
the Nffi. and especially important links between 
f it and the educational system. 



The HIE will take -over Ujc principal funding of 
the laboratories and centers. When it docs so, t 
It should aim to create a more mutually satis- 
factory relationship betv/een the sponsoring 
agencies and the university-based and independent 
research institutions. 

After stating the objectives, of. the proposed relationship, the 
report lists the following three means of achieving those objec* 
tives: 1) "Creation of additional laboratories, centers and other 
Independent agencies as the needs for nev; ones are demonstrated," 
2) "Institutional support should be a major portion of an insti- 
tution's budget only in the first few years. • .After that period, 
the majority of an institution's budget should be program support, 
obtained in some form of competition with comparable institutions," 
and 3) "Multiple sources of support for the laboratories and other 
applied research and developmental organizations should be 
.encouraged." 

The proposed policy fully meets each of these criteria. A mechanism 
for creating new institutions has been presented in some detail. 
The existence of the mechanism does not guarantee the creation of 



- 45 - 

come abuut in response to ncedis^ not because of a mechanism. The 
mechanism does enable and facilitate the process. 

Hie Maturity Model In the proposed policy is completely consistent 
vith the second listed "means" to be employed by NIE. It goes 
further in that it describes an orderly progression of a new 
institution from an institutional form of support to program 
support and dcfincr .the .'J.r.tervening steps and criteria for 
advancement. 

The proposed policy also encourages the concept of '^multiple 
sources of support" by defining the Program Plan to be a unit of 
vork for vhich support from any agency may be sought. 

* The NIE Planninp. Unit 
The current plans for NIE are knoim to be in complete harmony vith 
this policy. Several members of the NIE Planning Unit have had 
direct input to its formulation. NIE planning documents , in 
describing funding policy, contain text vhich has been taken from 
these support policy documents, l^ile it is recognized that the 
activities of the Planning Unit are essentially advisory at this 
point, there is good reason to expect that most of their 
recommendations v;ill be implemented. 

CONCLUSION ' 

The system proposed In this paper i s not fre e from bugs --the 

institutions for vhich this is designed are too large and 
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complex to be* fully explained in a few pages* This system does, 
however » provide a means for responding to all of the objectives 
listed at the outset. It can lead to a curbing of the policy of 
attrition vhich has characterized the effort during the past few 
years. In addition, by insisting on comprcl.cnsivc program plans , 
multi-year commitment and the associated stability can become a 
' reality and the Fe^^»r^ . ft^^trtfoy will have firm dollar amounts to 



use for justification vhcn requesting an expansion in appropriations 
for institutions. 
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Vol. 3, No, 2. Winter r970. 

'3« Ward Mason ^ DMT Institutional Support Policy , a vorking paper 
(inimeo) • 
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4- & 5, The organization that will implement the various aspects 
discussed In the paper include the following: 

. The Program Management Branch will have primary responsibility 
for the quality control role. -ut' 

The Assessment Support Branch will have primary responsibility 
for the quality assessment role, 

6* Roger E, Levi en, National Institute of Education: Prelir.iinarv 
JPlan for the Proposed Institute , HLi; Report No, R-657, luMXti 
Corporation » February 1971, . 
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QUESTIONS AMD ANSWERS 
Ihe following iiTC some selected questions that have been asked 
over a period of several months interaction with persons within 
and outside chc Federal establishment, and particularly with those 
In the laboratories and centers who will be most directly affected, 

Hou docs one reconcile the definition given of a program (commitment 
to objectives) and the requirement for providing projected budget 
and completion date data? 

Tlie program that receives a moral commitment for funding by the 
agency may be. In fact if often will be, only a subset of the 
long-term objectives that are envisioned by the institution. 
Because of the practical problems which limit the projection of 
eound plans, it will often be necessary to obtain commitments to 
logically divided segments. Therefore the time and budget limita- 
tions may pertain to specified time increments within the endeavor 

« 

with an added mechanism provided to change these limitations if 
that becomes necessary. 

How can a Basic Program Flan be modified after it has received 
agency cotnmltment? 

I 

The institution may prepare a modified version which Incorporates 

i 

the revisions entailed by circumstances since the previous commit- 
ment was made and request that the agency perform an intervention 
review. 



Can a con:milmcnt be terminated as a result of on intervention 
review vhcn that review was made at the request of the institution 
for the purpose of examining a modified plan? 

No. Only the question of the revised plan will be addressed* 
However, if there is obvious reason to doubt the quality of 
the program, the results of that review could stifnulate the 
agency to make its own investigation. 

Is the lack of expected Congressional appropriations adequate 
grounds for terminating a commitment? 

No* Program commitments will be terminated only for reasons due 
to unsatisfactory quality or progress, or for significant devia«- 
tlons from the objectives or budget of the program plan to which 
coBBQltment was made* Programs under commitment will have equal 
priority and, in the case of necessary short funding, budget 
reductions will be distributed among all programs in an equitable 
manner* 

Who decides what part^f implementation costs are to be paid from 
R&D funds and what part from other funds? 

Ihe legislation may help to decide that question* There may not 
be such a distinction* If there is, it may not be entirely clear* 
It will primarily be the responsibility of the heads of the agencies 
(units, divisions, etc.) In charge of the respective funds to worljf 
out the necessary linkages* 



Can a mature institution elect to regress to an earlier stage 
In the Maturity Model? 

I 

No. Regression is normally not permitted although the agency 
vill retain the prerogative of moving «in institution back if its 
purposes are better served thereby. If this is done, it will be 
In lieu ol: a more s^yeT%»' ^'^jon. 

I , • ■ • • 

Why is independent research not lumped in with a larger fee amount? 

Recent studies performed by the General Accounting Office have 
indicated that contractors who had authority to use fee money 
for independent research were, with few exceptions, not doing so. 
' It was GAO!s recommendation^ that independent research be a direct 
cost item. 



